BARRY J. GURLAND, M.R.C.P., D.P.M. 
LAWRENCE SHARPE, M.B., D.P.M. 
ROBERT J. SIMON, M.A. 

JUDITH KURIANSKY, Ed.M. 
PAMELA STILLER, A.A. 


On the Use of Psychiatric Diagnosis 
for Comparing Psychiatric Populations * 


The work of the US-UK Diagnostic Project has brought us face 
to face with the problem of comparing psychiatric disorders be- 
tween different populations. It seems appropriate to review today 
this aspect of our work, because such comparisons are an important 
part of research into the interaction between social factors and 
psychiatric disorders. 

Our work began in 1967 as a joint collaborative project between 
the Institutes of Psychiatry in New York and in London, with Dr. 
John Cooper heading the London team and myself (Barry Gurland) 
heading the U.S. team. The question initially posed for us by Dr. 
Joseph Zubin, the Project director, and Dr. Morton Kramer, of the 
National Institute of Mental Health, was whether diagnoses made 
by hospital psychiatrists during the course of their routine duties 
could be used to point up differences between the patient popula- 
tions of the US and the UK (1, 2). Many eminent psychiatrists had 
already drawn attention to the startling differences between the 
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two countries in the relative proportions of schizophrenia and 
affective disorders reported by public mental hospitals (3, 4,5). Tf 
hospital statistics were to be believed, then affective disorders were 
much more common in the UK patient populations, while schizo- 
phrenia was relatively more common in the US. With a proper 
skepticism, many psychiatrists suspected that cross-national dif- 
ferences manifested in hospital statistics were, at least in part, due 
to differences in the diagnostic habits of US and UK psychiatrists. 

In examining these issues we have employed several techniques: 
(1) we have examined patients ourselves; (2) we have shown video 
tapes of interviews to audiences of psychiatrists; and (3) we have 
utilized case records. We have applied these techniques to the ex- 
amination of hospital diagnoses, as used for cross-national com- 
parisons, intranational comparisons, comparisons between dif- 
ferent services of the same hospital, and historical comparisons. 
The studies I have selected for mention today are intended to illus- 
trate the techniques and issues that are relevant to that part of our 
work having to do with comparisons of patient populations. 

A major part of our effort has gone into the selection and devel- 
opment of reliable methods for gathering information on patients 
whom we examine ourselves. The pivot around which these methods 
turn is the use of structured interviews. In this we have drawn upon 
the work of Drs. John Wing (6) and Robert Spitzer (7). In struc- 
tured interviews, the questions to be put to the patient are stipu- 
lated, and the relevant responses are indicated and pre-coded. 

The structured interviews we utilize cover the patient’s current 
mental state and his past psychiatric history, taken from the patient 
and from an informant (when one is available). From this informa- 
tion we have been able to make reliable psychiatric comparisons 
between different populations in several different ways. The sim- 
plest and most conventional way is by means of the diagnoses made 
by consensus of project psychiatrists, after reviewing the infor- 
mation arising from the structured interviews and consulting the 
Diagnostic Manual. Another way is through computer diagnoses 
generated from the pre-coded items of the structured interviews, 
either by decision tree or by statistical models. We have included 
in our schedules items that permit computer diagnoses to be made, 
based on the programs and criteria provided by Drs. Spitzer and 
Endicott (8) in the US or by Drs. Wing and Cooper (9) in the UK. 
Needless to say, the diagnoses arrived at by these different com- 
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puter programs may vary from each other in a way that simulates 
the contrasts between the diagnostic habits of American and British 
psychiatrists. A third mode of comparison, which is also available 
from the above data, is by way of the symptoms of psychopathology 
that are found in the. samples of patients. For purposes of this 
comparison, the symptoms may be examined individually, clustered 
according to traditional clinical experience, or grouped by empiri- 
cally derived factors. Dr. Joseph Fleiss (10) has identified 25 fac- 
tors of psychopathology from our data. Comparisons can also be 
made on the basis of mutually exclusive syndromes of psychopa- 
thology, which may be either traditional, arbitrary, or empirical. 
Finally, mathematical techniques based. on discriminant function 
analysis have been applied to comparisons of our patient popula- 
tion by Dr. Robert Kendell. Evidence for the cross-national reliabil- 
ity of our methods has been presented in several publica- 
tions (11, 12). 

Thus the information obtained through our personal examination 
of patients can be used in any of these several ways as a yardstick 
for determining whether two populations are similar or dissimilar 
with respect to psychiatric disorder. Against this yardstick, one is 
also able to examine whether or not hospital diagnoses give equiv- 
alent results when used for the same comparisons. In the time given 
to me today, I shall single out the use of the project diagnosis as a 
yardstick. 

In the study that I shall now describe, the information going into 
a project diagnosis was kept completely independent from that 
which was going into the hospital diagnoses on the same patients. 

Figure 1 shows the results of a survey of just under 400 consecu- 
tive admissions, aged between 20 and 60 years, who were admitted 
to the state psychiatric hospitals supplying Greater New York and 
a sample of the area mental hospitals supplying London. Details of 
the samples studied and the methods used have been published 
elsewhere (11, 12). 

The ratio of schizophrenia to affective disorder in New York is 
compared with that in London. If the comparison is made on the 
basis of the hospital diagnoses, the ratios in the two cities are found 
to be quite different. In New York, it is over 9 to 1; in London, it is 
about even. However, if this same comparison is made on the basis 
of project diagnoses, the ratios in the two cities are found to 
be about equal. 
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Fig. 1 NEW YORK LONDON 
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The ratio of schizophrenia and affective disorders among admissions to 
public mental hospitals, as judged by hospital and by project diagnosis. 


We have published evidence that the project diagnoses were 
reasonably consistent on the two sides of the Atlantic (11, 12). Thus 
it is clear that the differences between the New York hospitals and 
those in London lie in the criteria they use for diagnoses. Cross- 
national comparisons utilizing hospital diagnoses may therefore 
be very misleading. 

So much for public mental hospitals in New York and London— 
but how far can we go in generalizing the above findings? My col- 
leagues Drs. Sharpe, Copeland and Kendell have examined this 
issue through the use of videotapes. Psychiatric interviews with 
selected patients have been videotaped and shown to several hun- 
dred psychiatrists, from a wide variety of backgrounds, in both 
countries. After viewing these videotapes, the psychiatrists re- 
corded their diagnoses and made certain ratings. Comparisons of 
the diagnoses based on this procedure have confirmed (13) that, 
despite notable exceptions, there is wide generality to the statement 
that US psychiatrists tend to make a diagnosis of ‘‘schizophrenia”’ 
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more readily than do UK psychiatrists. This statement holds true 
to a greater or lesser extent, irrespective of the background from 
which the psychiatrist comes, his age, his experience, or the region 
of the country in which he practices. 

The reason why this comparison has been made between psy- 
chiatrists from the Institute of Psychiatry in New York and from 
the corresponding institute in London, was that it might be thought 
that psychiatrists in teaching institutes would be less likely to 
show transatlantic differences in diagnosis, since they are more 
likely to meet and communicate with their colleagues on the oppo- 
site side of the ocean than are psychiatrists in public mental hospi- 
tals. 

Figure 2 presents the results of showing a series of eight video- 
taped interviews to audiences averaging about 15 psychiatrists at 
each of the two institutes. 

The dramatic differences that emerge are always in the same 
direction: the New York psychiatrists diagnose schizophrenia more 
often than do their London colleagues. 

It should now be readily accepted that hospital diagnoses, rou- 
tinely made, cannot be used for cross-national comparisons. Our 
videotape studies comparing the diagnostic habits of psychiatrists 
from different regions of the same country suggest that, especially 
in the U.S., hospital diagnoses should not be used for intranational 
comparisons either. 

Nevertheless, one might still expect that hospital diagnoses can 
be used for meaningful comparisons between patient samples within 
the same hospital system. However, Dr. Pasamanick (14) has 
already shown that even psychiatrists in different wards of the 
same hospital may use different standards of diagnosis. We con- 
firmed this by applying project diagnoses to samples of patients 
from three services in the same hospital system. The first sample 
came from the psychiatric emergency room, the second from the 
‘*short-stay’’ psychiatric unit within the same hospital, and the 
third from the ‘‘long-stay’’ unit of the same hospital system. 
Details of the samples and methods have been published else- 
where (15). 

Figure 3 compares the proportion of patients found to be either 
schizophrenic or suffering from affective disorders, as judged by 
hospital diagnosis and again by project diagnosis. 

The trend shown by the hospital diagnoses is for schizophrenics 
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Fig 2 Eight videotaped interviews as diagnosed by psychiatrists at the 
New York State Psychiatric Institute and at the Maudsley Hospital, London 
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to be preferentially selected (from patients in the emergency room) 
for admission into the short-stay unit and, even more so, into the 
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Fig. 3 Routine Hospi tal and Standard Project Diagnoses in the 
Emergency Clinic, Short Stay Unit and Long Stay Unit 
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long-stay unit. However, the project diagnoses (of proven reliabil- 
ity) suggest that it is affective disorders that are preferentially 
selected into the short-stay unit, while the schizophrenic admissions 
are concentrated in the long-stay unit. 

So far we have dealt with the interpretations to be placed upon 
comparisons of contemporaneous samples of patients. However, 
it is frequently of interest to compare samples of patients between 
different eras. For instance, the proportion of patients diagnosed 
as schizophrenic each year among the admissions to this Institute 
shows a very striking tendency to wax and wane across the decades. 

Figure 4 shows the annual proportions diagnosed as schizo- 
phrenic among admissions to the Institutes in New York and in 
London between 1930 and 1969. 
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Fi 4 Annual percentages of schizophrenia, by hospital diagnosis, among admissions to the 
g. New York State Psychiatric Hospital and to The Maudsley Haspital, London 


First sample Second sample 


Between 1930 and 1942, only about 20-30% of all admissions 
were receiving a hospital diagnosis of schizophrenia in either 
institute. In London, this proportion has remained fairly constant 
over the years; however, a very different picture is evident in New 
York. From 1948 to 1952, there was a steady increase, year by year, 
in this proportion. In 1952, for example, almost 80% of the patients 
in New York were being diagnosed as schizophrenic. We therefore 
decided to examine these statistics more closely. Fortunately, the 
case reports at this Institute are exemplary, in that the format has 
remained relatively constant over the last 40 years; they are also 
extraordinarily complete, with numerous verbatim accounts of 
the complaints of patients and details of symptoms, behavior, and 
psychiatric history. Employing statistical procedures designed by 
Dr. Edward Deming, Mrs. Kuriansky of our unit drew two samples 
of case records. This first sample came from the decade 1932-1942, 
when the diagnosis of schizophrenia was at low ebb. The second 
sample came from the decade 1947-1957, when the proportion of 
schizophrenics diagnosed had more than doubled. The case records 
were Xeroxed and references to diagnosis, date of admission, his- 
torical period, and treatment erased. Sixteen highly experienced 
psychiatrists then rediagnosed these patients from the case records, 
with each psychiatrist diagnosing four cases from each decade. 

The diagnoses made by these 16 psychiatrists showed no differ- 
ence in the proportion of schizophrenics admitted in the two dec- 
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ades. Further details of this study will appear elsewhere. However, 
from the sketchy results I have given here, it is evident that histor- 
ical trends must be interpreted with particular caution when they 
are based upon hospital diagnoses. 

The findings I have reviewed so far may be summed up as sug- 
gesting that routine hospital diagnoses may be very misleading 
when used to compare psychiatric populations. If comparisons 
based on diagnosis are desired, then it seems necessary to employ 
structured interview techniques and a consistent set of criteria for 
diagnosis. Unfortunately, the derogation of routine hospital diag- 
noses is often emphasized at the expense of overlooking the tech- 
niques for arriving at reliable diagnoses. 

This is not to say that reliability is enough. There still remains 
the knotty problem of choosing criteria for diagnosis. Our studies 
have shown that American psychiatrists tend to have a broader 
conception of schizophrenia than do British psychiatrists; the 
question therefore arises as to which conception to adopt in 
comparing populations. Let us assume that both conceptions are 
applied, and with equal reliability, to a comparison of the propor- 
tion of schizophrenics in two populations, X and Y. Now obviously 
the schizophrenics found in either X or in Y will be greater in 
number when judged in terms of the broad conception than when 
judged in terms of the narrow conception. However, what is not 
sufficiently stressed is that it may also be found, for instance, that 
there are more schizophrenics in X than in Y, in terms of the broad 
conception, and exactly the opposite (more in Y than in X) in terms 
of the narrow conception. 

To illustrate this point, let me refer back to our comparison of 
patient populations from two different decades of admissions to 
this Institute. We compared samples of these populations, using 
first a broad conception and next a narrow conception of schizo- 
phrenia. This was done by dividing the 16 psychiatrists who were 
making rediagnoses into those who diagnosed schizophrenia fre- 
quently and those who diagnosed it infrequently in these samples. 
The number of schizophrenics diagnosed in terms of broad con- 
ception increased from the first to the second decade; the number 
of those diagnosed in terms of a narrow conception decreased 
between the two decades. 

An even more important illustration of the same principle is 
found in comparisons between two populations, of which one is 
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defined as schizophrenic and the other as not schizophrenic; a 
correlation is then sought with an independent variable, such as 
physiological response or, say, concordance rate between iden- 
tical twins. Again, different results may be obtained, depending on 
whether the schizophrenic group is defined in terms of a broad 
or a narrow conception. Evidence for this statement may be found 
in the work on physiological responses by Dr. Sutton and his col- 
leagues (16,17,18) at the Biometrics Laboratories. These work- 
ers found that physiological distinctions between normal and 
schizophrenic patients were much sharper when these labels were 
applied by a computer program than when broader clinical con- 
cepts of schizophrenia and normality were employed. Further 
evidence comes from studies on concordance rates of schizophrenia 
among identical and nonidentical twins, conducted by Drs. Shields 
and Gottesman (19). The relationship between concordance of 
schizophrenia and monozygosity was found to be strongest when 
the diagnosis was based on a conception of schizophrenia that was 
neither very narrow nor very broad, but rather somewhere between 
these two extremes. 

If two conceptions of schizophrenia give opposite results in the 
same comparison, then which conception should be chosen for that 
comparison? I shall continue to skirt the subject of validity, but 
I would like to offer a few tentative remarks on the relative use- 
fulness of these conceptions in psychiatric comparisons. Consid- 
eration must be given, of course, to the purpose of the comparison. 
For genetic research, it appears that a conception that is neither 
very broad nor very narrow may be most useful. Our historical 
study has left us with the impression that, in longitudinal studies 
over a long period of time, it is easier to adhere consistently to a 
relatively narrow as against a broad conception of schizophrenia. 
Our studies (20) on the selection of treatment and the duration of 
hospitalization suggest that they are closely related to a concep- 
tion of schizophrenia that is restricted to easily observable mani- 
fest psychopathology, and excludes patients whose predominant 
symptom is depression. It is entirely possible, however, that a 
broad conception of schizophrenia may lead to the discovery of an 
underlying process that unifies a wide variety of syndromes of 
psychopathology. 

In this open-ended situation, it would be unwise to assign one’s 
allegiance to any one of these conceptions of schizophrenia. A 
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more fruitful approach might be to assign patients to such cate- 
gories as, for example, ‘‘universally agreed to be schizophrenie,’’ 
or ‘‘universally agreed not to be schizophrenic.’’ Directly relevant 
to this kind of approach is the data gathered on agreements and 
disagreements between American and British psychiatrists (21, 
22). We are in many cases able to predict from the characteristics 
of the patient, such as age and symptoms, whether there is likely 
to be agreement or disagreement on the diagnosis of schizophrenia. 

This approach may seem to be edging us away from diagnosis 
and into other methods of classifying ; however, I shall close with 
one last reference to our data on diagnosis. We have found (23) 
that a patient can be more precisely classified by reference not only 
to his main diagnosis, but also to his alternative diagnosis. An al- 
ternative diagnosis is given to a patient when there is uncertainty 
about his main diagnosis. Our data showed that patients given a 
main diagnosis of affective disorder and an alternative diagnosis 
of schizophrenia were intermediate in psychopathology and dura- 
tion of hospitalization, between those groups of patients whose 
diagnosis was exclusively an affective disorder and those whose 
diagnosis was exclusively schizophrenia. In short, it appears that 
alternative diagnoses are useful in defining groups of patients with 
borderline or mixed syndromes. It is in these latter groups that 
one finds the largest number of disagreements between American 
and British psychiatrists. 

I hope it will be clear from these remarks that, although our 
interest in methods of comparing psychiatric populations is by no 
means restricted to the use of psychiatric diagnosis, and although 
we feel that hospital diagnoses as routinely practiced leave much 
to be desired, we nonetheless continue to work on the assumption 
that psychiatric diagnosis, when it is carefully made, can be a sen- 
sitive and productive method of comparing psychiatric populations. 
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